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Biocybernetic  Factors  in  Human  Perception  and  Memory 

SUMMARY 

This  project  is  concerned  with  the  development  of  the  biocyber¬ 
netic  concepts  and  techniques  required  for  the  analysis  and  training  of 
skills  useful  for  the  manipulation  and  control  of  concrete  memory  func¬ 
tions.  Our  effort  has  been  concentrated  on  those  aspects  of  concrete 
memory  which  could  be  expected  to  make  a  substantial  contribution  to 
practical  volitional  memory,  and  we  plan  to  bring  them  under  stronger 
individual  control.  To  realize  the  biocybernetic  expansion  of  human 
memory,  we  choose  to  use  the  real-time  computerized  monitoring  and  feed¬ 
back  of  spatial  and  temporal  cues  that  serve  as  keys  to  memory  retrieval. 
A  PDP-15  computer  system  has  been  selected  and  purchased  for  this  purpose. 
The  selection  of  this  computer  system  is  based  on  its  real-time  capa¬ 
bility.  This  technical  report  is  concerned  with  the  development  of  soft- 
V'-re  and  hardware  for  our  purpose  and  the  preliminary  tests  of  some  new 
techniques  in  r.al-time  monitoring  and  prediction  of  brain  states  via 
real-time  on-line  analysis  of  electroencephalographic  signals. 

The  PDP-15  computer  system  is  an  18-bit  computer  with  unique  capa¬ 
bilities  suited  to  high-speed  data  acquisition  and  processing.  The 
system  which  we  have  purchased  has  a  core  memory  of  16K  words  comple¬ 
mented  with  several  processors  and  peripherals  to  handle  our  needs.' 

The  most  significant  feature  is  the  RSX-15  (phase  II)  software  system 
which  makes  the  real-time  monitoring  possible.  We  have  also  developed 
special  software  and  designed  hardware  for  interfacing  laboratory 
instruments.  Details  of  these  software/hardware  combination  are  described 


in  the  report. 
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A  new  technique  for  real-time  monitoring  of  brain  states  has  been 
developed  and  partially  implemented.  This  technique  involves  the  reali¬ 
zation  of  a  discrete  "phase-locked  loop"  system.  The  requirement  of 
real-time  processing  has  confronted  us  with  many  technical  challenges. 

We  have  overcome  some  of  them ;  others  remain  to  be  solved.  These  real¬ 
time  monitoring  and  prediction  scheme  is  described  in  detail  in  this 
report.  Other  methods  such  as  the  use  of  autoregressive  processes  for 
modeling  have  been  investigated.  It  is  also  described  in  the  report. 

Preliminary  works  on  eye-movement  tracking  have  been  completed. 
Extensive  work  in  this  area  is  to  be  followed.  We  give  a  somewhat  de¬ 
tailed  account  of  the  preliminary  eye-movement  measurement  scheme  in 
the  report. 

In  conclusion,  our  work  has  proceeded  as  planned  in  the  proposal 
except  that  delays  have  been  caused  by  the  late  delivery  of  the  PDP-15. 
There  is  also  the  delay  caused  by  diverting  our  effort  to  writing  many 
utility  programs  which  were  thought  to  be  supplied  by  Digital  Equipment 
Corporation  (DEC)  through  the  misrepresentation  of  the  manufacturer's 
representatives.  These  unforeseen  delays  have  hindered  our  work  and 
may  upset  the  schedule  for  completing  the  work  as  proposed.  In  this 
■eport,  we  give  an  account  of  our  technical  accomplishments  up  to  this 
point.  The  implications  of  this  project  for  the  Department  of  Defense 
lie  in  our  specific  misrion  of  investigating  the  possibility’  of  devising 
new  and  unusual  techniques  that  will  permit  the  development  of  stronger 
imagery  in  men  with  normal  memories.  Since  it  is  definitely  an  asset 
for  the  military  man  to  have  the  ability  to  absorb  information  rapidly 


and  to  retain  it  intact  for  long  periods  of  time,  we  seek  to  develop 


ill 


and  to  intensify  the  post-stimulus  imagery  as  far  as  possible  in  the 
direction  of  photographic  memory. 
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I.  INTRODUCTION 


This  research  project  is  concerned  with  the  development  of  the  bio- 
cybernetic  concepts  and  techniques  required  for  the  analysis  and  training 
of  skills  useful  for  the  manipulation  and  control  of  the  concrete  memory 
functions,  viz.,  those  related  to  the  more  concrete  sensory  images.  In 
particular,  we  concentrate  on  the  problem  of  achieving  biocybernetic 
expansion  of  human  memory  through  the  use  of  real-time  computerized 
monitoring  and  feedback  of  spatial  and  temporal  cues  that  serve  as  keys 
to  memory  retrieval.  There  is  strong  evidence  which  can  be  advanced  to 
show  that  the  human  nervous  system  depends  heavily  upon  spatial  and  tem¬ 
poral  cues  both  in  the  encoding  and  decodr.ng  of  memories  especially 
those  related  to  the  sensory  images. 

Our  scheme  is  first  to  develop  and  implement  techniques  for  real¬ 
time  monitoring  and  prediction  of  central  nervous  activities  through 
the  electroencephalographic  signals.  Then  we  shall  use  this  information 
so  as  to  arrange  extraordinary  coincidences  between  various  brain  states 
and  the  delivery  of  sensory  stimulation.  The  visual  stimuli  are  to  be 
presented  via  the  complex  tachistoscopic  batteries  for  either  monopic 
or  dichopic  viewing.  Meanwhile,  the  eye-position  and  eye-movements  are 
to  be  measured  by  a  unified  system  as  to  obtain  their  optical  and  elec¬ 
tro-physiological  estimators.  Finally,  combining  these  techniques  and 
the  use  of  a  feedback  scheme  to  close  the  control  loop,  we  expect  to 
obtain  a  tighter  grip  on  the  factors  underlying  image  persistence  and 
image  dissipation.  In  this  report,  we  describe  our  accomplishments  in 
developing  and  implementing  those  techniques  towards  this  goal. 
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We  chose  a  PDP-15  computer  system  manufactured  by  Digital  Equip¬ 
ment  Corporation  (DEC)  for  its  unique  capabilities  suited  to  real¬ 
time  data  acquisition  and  processing  to  realize  our  schemes.  Much  time 
has  been  spent  on  bringing-up  the  computer  system  to  its  full;,  opera¬ 
tional  status.  In  the  next  section,  we  describe  our  effort  in  making 
the  computer  system  function  and  fulfill  our  needs,  and  its  integration 
with  other  laboratory  instruments  through  our  own  designed  interface 
hardware.  In  section  III,  we  present  a  new  technique  for  real-time 
monitoring  and  predicting  various  brain  states  via  EEG  signals  and  its 
partial  implementation;  we  also  give  a  method  for  modelling  EEG  signals 
and  some  of  the  results.  The  preliminary  work  on  eye-movement  measure¬ 
ment  and  tracking  is  presented  in  section  IV.  Some  conclusion  and  ob¬ 
servation  are  made  in  the  last  section. 

The  work  has  progressed  as  we  proposed  but  not  at  the  pace  that  we 
estimated.  This  is  due  to  many  unforeseen  delays  caused  by  the  late 
delivery  of  the  PDP-15  computer  system  and  diversion  of  our  efforts  in 
writing  many  subroutines  supposed  to  be  supplied  by  the  manufacturer. 

II.  PDP-15  COMPUTER  SYSTEM  AND  ITS  INTEGRATION 
WITH  LABORATORY  INSTRUMENTATION 


The  PDP-15  computer  system  which  we  have  purchased  includes  the 
following  items; 

PDP-15/35  Disk  Operating  Advanced  Monitor  System,  consisting  of; 
16,384  18-bit,  800-ns  core  memory 

-  LA30  DECWriter 

-  PC 15  High  Speed  Paper  Tape  Reader/Punch 

-  KE1 5  Extended  Arithmetic  Element 

-  KA15  Automatic  Priority  Interrupt 

-  KW15  Real  Time  Clock 
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Advanced  Moniotr  System  (cont.):  ! 

-  TCI 5  DECTape  Control  ! 

-  TU56  Dual  DECTAPE  Transport  j 

-  RF15  DECdlsk  Control 

-  RS09  DECdisk  Drive,  262,144  words 

i 

KM15  Memory  Protect 
KF15  Power  Fail 
FP15  Floating  Point  Processor 
KT15  Memory  Relocation 

TC59D  Magnetic  Tape  Transport  Control  for  up  to  8  TU10A,  TU10B, 
TU30A ,  TU30b  Magnetic  Tape  Transport  Units 

TU10A  9-Track,  45  ips  Magnetic  Tape  Transport;  800  bpi 

VP15C  Oscilloscope  Display,  VR14  X-Y  Display  Unit  (7"  x  9”  CRT) 
and  Control 

XY15AB  0.005-Inch  Step  18,000  Steps/Minute  31-inch  drum,  Calcomp 
Model  563  and  control 

CR15  30  cpm  Reader  and  Control  (Punched  Cards) 

AA15B  Multiplexer  Control  for  up  to  16  Type  AAC3  12-bit  digital- 
to-analog  converter  channels 

AAc3  Digital-to-Analog  Converter,  single  buffered,  OV  to  +  10V 

ADI 5  128  Channel  A/D  Converter  (Medium  Speed)  Three-cycle  data 
channel  capacity  with  provision  for  mounting  the  first  32  channels; 
each  4-channel  group  requires  one  BA124 

BA124  Four-Channel  MOS  FET  Multiplex  switch;  one  required  for  each 
4-channel  group 

CSS  18-Bit  Digital  I/O  Interface 
RSX15  Software  Package 
RASP  Software 

LP15-F  Line  Printer  (on  lease) 

This  computer  system  is  integrated  with  other  laboratory  instrumen¬ 
tation  ns  shown  by  the  block  diagram  in  Figure  1.  All  of  the  interface 
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hardware  except  the  CSS-18  I/O  interface  are  designed  and  built  or 
to  be  built  by  us.  We  give  a  brief  description  of  these  interface 

hardware  and  a  status  report  of  their  various  stages  of  implementation. 

(1)  Interfacing  of  Special  Peripheral  Devices 

(a)  General:  A  general  method  for  the  interface  of  the  special 
peripheral  devices  required  for  this  project  was  developed  using 
a  specail  device  (the  CSS  18  bit  interface)  provided  by  the 
computer  manufacturer.  This  is  a  bidirectional  interface  package 
which  does  all  of  the  address  decoding  and  timing  functions  re¬ 
quired  of  a  device  controller.  Our  use  of  several  devices  requires 
a  device  selector/data  multiplexer  be  built,  and  then  additional 
special  conic  (level  shifting,  inverting,  etc.)  unique  to  each 
device.  Thus  far,  the  special  interface  units  have  been  designed, 
and,  where  noted,  built.  The  device  selector  har  not  been  completed. 
It  is  presently  circumvented  by  paralleling  several  devices. 

(b)  Tachistoscope:  The  tachistoscope  interface  has  been  completed 
and  is  operational.  The  unique  functions  required  were  level 
shifting  and  pulse  generation,  for  a  total  of  six  commands. 

(c)  Random  Access  Slide  Projector:  The  interface  unit  has  been 
designed  and  is  currently  under  construction.  Logic  was  required 
to  allow  parallel  entry  of  data,  and  to  properly  time  the  control 
signals.  Level  shifting  of  all  command  and  data  lines  is  also 
required. 

(d)  Time-Code  Generator:  The  interface  for  the  tape  search  unit/ 
time  code  generator  is  not  completed.  The  functions  required  are 
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timing  and  control,  and  inversion  of  data.  Final  delivery  of  the 
TSU/TCG  is  not  scheduled  until  later. 

(e)  Alden  3-Axis  Recorder:  The  interface  for  this  unit  is  not 
completed. 

(2)  Modification  of  Existing  Peripheral  Devices 

(a)  Analog-to-Digit al  Converter:  A  modification  to  this  unit  is 
in  progress  to  add  an  external  clock,  to  relieve  the  CPU  of  the 
timing  workload 

(b)  Syst-  CRT:  The  present  refresh  type  display  unit  is  being 
replaced  with  a  Tektronix  type  611  storage  display  unit.  This 
will  allow  use  of  the  CRT  during  periods  of  high  CPU  utilization. 
Present  plans  are  to  retain  the  VR14  scope  presently  installed  for 
off  line  tasks,  driven  by  the  system’s  digital-to-analog  converters, 
and  to  use  the  storage  unit  as  a  display  device  for  real  time  tasks. 
To  bring-up  the  PDP-15  computer  to  its  operational  stage  and  to 

fulfill  our  own  special  needs,  we  need  to  generate  software  which 
falls  in  the  following  three  categories: 

(a)  General  Support  Programs  and  Subroutines:  These  include 
utility  programs  and  library  routines  written  for  use  by  all  project 
personnel.  These  are  extensions  of  the  operating  system  and  util¬ 
ity  packages  produced  by  the  manufacturer  of  the  computer,  which 
are  required  for  day  to  day  operations. 

lb)  Application  Programs:  These  are  programs  which  perform  spe¬ 
cific  functions. 

(c)  Software  investigations:  Research  effort  required  for 
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production  of  functional  programs.  Most  work  is  concerned  with 
the  timing  constraints  on  real-time  system  operation. 

Most  of  the  software  in  categories  (a)  and  (c)  are  completed  since 
these  form  the  basis  for  operation  of  the  system  in  our  application. 

In  the  sequel,  we  give  a  more  specific  account  of  what  has  been 
accomplished  for  each  category. 

(A)  General  Support  Programs  and  Subroutines 

The  PDP-15  Real-Time  Executive  (RSX)  was  designed  for  a  general 
scientific  user.  In  order  vo  tailor  the  system  to  our  specific  needs 
certain  modifications  to  the  DEC  software  were  necessary.  Unfortun¬ 
ately,  these  modifications  could  not  be  renlized  using  the  RSX  system 
(due  mainly  to  the  large  core  requirements  of  the  resident  monitor). 

We  were  therefore  forced  to  use  DEC'S  disk  oriented  batch  processing 
monitor  (DOS)  to  update  and  assemble  the  RSX  system. 

The  first  such  modification  was  extending  the  RSX  teletype  handle 
to  simulate  horizontal  tabulation  on  our  high-speed,  teletype  compa¬ 
tible  teleprinter.  Unlike  a  teletype,  the  LA30  has  no  hardware  tabula 
tion.  Additional  core  was  added  within  RSX  to  monitor  the  current 
position  of  the  carriage,  make  note  of  new  read/write  requests,  and 
print  blank  characters  when  necessary  to  achieve  carriage  movement 
corresponding  to  tabulation.  We  arc  now  able  to  1)  enter  columnar 
data  with  much  less  mental  effort,  and  2)  reduce  symbolic  file  space 
by  at  least  a  factor  of  two. 

In  order  to  allow  the  system  to  be  "booted  in"  from  disk  without 
using  the  paper  tape  reader,  we  made  a  second  extension  to  RSX.  The 
system  must  he  "booted-ln"  to  start  the  system  in  the  morning  and  to 
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(  1 

refresh  memory  following  a  severe  system  failure.  The  delivered  system 
required  a  "warm  start"  tape  to  be  placed  in  the  paper  ;tape  reader 

i 

along  with  the  setting  of  certain  console  switches.  By  placing  &  copy 

of  the  warm  start  program  within  the  resident  monitor  (less  than  20 

• 

words)  we  are  now  able  to  warm  start  the  system  by  simply ; depressing 

t 

the  START  switch.  Since  paper  tape  is  cumbersome  to  w.orH  with,  we 
save  time  and  effort. 

In  addition  to  a  powerful  operating  system  most  computer  users 

l  i 

need  an  assortment  of  utility  routines  such  as  memory  and  magnetic 
tape  dumps,  graphics  support  (plotter,  CRT),  special  purpose  subrou¬ 
tines,  magnetic  tape  copy,  etc.  Although  the  DOS  system  supplies  ; some 

i 

i 

utility  software,  RSX  includes  virtually  none.  We  describe  in  detail 

i 

the  current  contents  of  our  utility  package  generated  by  us.  •  i 
CORE/DISK  DUMP  .  , 

i  f 

An  RSX  user  may  examine  vhe  contents  of  the  disk  or  memory  through 

l 

use  of  the  MCR  function,  OPEN.  OPEN  allows  the  inspection  of  only  one 

i 

word  per  invocation;  however,  it  is  unsuited  for  displaying  lqrge, 

contiguous  blocks  of  core  and  disk.  For  this  reason  an  additional 

'  i  i 

MCR  function,  DMP,  was  written.  The  syntax  definition  of  the  DMP 

I  ! 

command  is  as  follows:  ‘  , 

i 

DMP^  [■>]  from  [u_j  to  ] 

where  from  =  starting  oore/disk  address 
to  =  ending  core/disk  address 
from  S  to. 

Both  the  starting  and  ending  addresses  must  be  octal  constants.  The 
optional  parameter,  "D",  is  specified  when  a  disk  dump  rathei*  thari  a 

i 
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core  dump  is  required.  The  dump  lisitng  will  be  written  on  logical 
unit  LUN  16  which  is  normally  assigned  to  the  line  printer.  DMP  first 
extracts  the  starting  and  ending  addresses  from  the  command  line,  and 
then  initializes  itself  by  filling  the  output  buffer  with  blanks.  As 
each  word  is  received  from  core  or  disk,  it  is  placed  into  the  output 
buffer.  H’hen  the  buffer  is  full  (eight  words),  it  is  printed  on  LUN  16. 

This  procedure  continues  until  the  requested  area  is  dumped.  To  under- 

« 

stand  the  making  of  the  program  is  through  the  study  of  its  flow-chart. 

t 

The  flowchart  for  DMP  is  shown  in  Figure  2. 

Magnetic  Tflpe  Dump 

A  prgoram  (DTDUMP)  is  available  to  DUMP  in  octal,  selected  blocks 

of  a  DEC  taped  assigned  to  LUN  19.  Since  DTDUMP  is  a  task  rather  than 

j 

an  MCR  function,  its  execution  is  initiated  through  the  REQUEST  function 

of  RSX.  The  user  is  asked  to  specify  the  beginning  and  ending  blocks 

I 

to  be  dumped  after  which  a  listing  is  produced  on  LUN  16  (line  printer). 
The  program  re-cycles  until  a  starting  block  of  zero  is  given  in  response 

to  DTDl/MP's  question. 

!  1 

MTDUMP  Program 

This  is  a  system  utility  program  written  to  print  out  the  data 
,on  9-track  800  BPI  industry  compatible  magnetic  tape,  in  an  octal  format. 

I 

It  is  a  task,  called  by  the  system  request  function.  The  program  uses 
i  the  console  teletype  for  user  input  of  the  expected  record  size  and  the 
number  of  fecords.  Each  record  is  read  in,  the  format  converted,  and 
dumped  to  the  printer.  Printing  suppression  is  used  for  all  zero  lines. 
The  program  will  run  even  if  the  incorrect  record  size  is  specified, 
with  the  extraneous  values  suppressed.  Termination  occurs  on  end  of 

i 
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file,  or  completion  of  the  required  number  of  records.  No  rewind  is 
built  in  to  the  program,  to  allow  restarting  the  dump  after  a  known 
number  of  records,  or  after  some  significant  event  on  the  tape  deter¬ 
mined  by  a  preceding  program.  A  brief  flowchart  is  shwon  in  Figure  3. 
Graphics  Software 

The  RSX  software  system  does  not  include  routines  to  support  the 
CalComp  incremental  X-Y  plotter.  A  temporary  subroutine  (PLOT)  was 
written  to  fulfil  our  present  needs.  This  routine  is  called  out  by 
the  following  FORTRAN  statement: 

CAL  PLOT  (N,  IDATA  , ICHAR  ) 

where  N  =  number  of  points  to  be  plotted 
1  —  N  —  10 

IDATA  =  an  INTEGER  array  of  ordinate  values 
0  S  IDATA (I)  <  2000 

ICHAR  =  an  INTEGER  array  of  character  codes 
0  £  ICHAR  (I)  <  3 

PLOT  was  designed  to  display  time-varying  functions  with  a  constant 
time  interval  between  data  points.  For  this  reason  no  abscissa  values 
need  be  specified  in  the  subroutine  call.  As  noted  above  the  ordinate 
values,  IDATA (I),  must  be  normal  izer'  to  lie  between  zero  and  2000  in¬ 
clusive.  Data  points  outside  of  this  range  are  simply  ignored.  Each 
call  to  PLOT  advances  the  paper  one  time  unit  in  the  positive  "X"  dir¬ 
ection. 

To  each  data  value  in  IDATA  is  associated  a  corresponding  character 
code  in  ICHAR.  It  is  capable  of  drawing  four  distinct  symbols  for  any 
IDATA (I)  as  shown  in  t lie  following  table: 
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Character 

Code 

Symbol 

Description 

0 

Vertical  Line 

1 

Horizontal  Line 

2 

□ 

Square 

3 

+ 

Plus  Sign 

ICHAR  allows  the  programmer  to  use  separate  symbols  for  each  graph  of 
a  multiple  graph  plot.  If  ICHAR  is  not  specified,  PI/)T  will  draw  a 
vertical  line  for  all  IDATA  values. 

A  flowchart  for  PLOT  is  shown  in  Figure  4.  After  moving  the  two 
input  arrays  into  a  buffer,  PLOT  sorts  IDATA  (and  corresponding  elements 
in  ICHAR)  in  order  to  minimize  the  time  required  to  plot  the  "N"  points. 
The  points  a.’e  then  plotted  in  their  sorted  order.  Notice  that  an  error 
conditions  result  in  an  immediate  exit  from  PI/)T.  A  more  sophisticated 
graphic  plot  routine  is  being  written. 

Special  Purpose  Subroutines 

The  PDP-15  has  a  group  of  eighteen  "data  switches"  or  "sense 
switches"  (numbered  0,1,..., 17)  mounted  on  the  operators  console. 

Since  the  positions  of  these  switches  may  be  dynamically  determined 
through  the  execution  of  a  hardware  instruction  (OAS),  programs  may 
use  these  switches  for  low  volume  data  input.  The  standard  DEC  soft¬ 
ware  allows  only  assembly  language  programmers  to  determine  the  data 
switch  settings.  In  order  to  extend  this  capability  for  FORTRAN  pro¬ 
grammers,  two  FORTRAN  callable  routines  have  been  created. 
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Fig.  '1  Flowchart  for  PLOT  Program 
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The  eighteen  data  switches  may  be  thought  of  as  single  eithteen- 
bit  binary  integer  since  each  switch  must  be  in  only  one  of  two  possible 
positions.  When  a  user  wants  to  ascertain  the  settings  of  all  or  most 
of  the  switches,  one  may  include  the  INTEGER  FUNCTION  LAS  in  his  program. 
When  calling  LAS  an  argument  must  be  specified.  For  example,  the  fol¬ 
lowing  short  FORTRAN  program  will  p- int  the  current  status  of  the  data 
switches  as  a  six-digit  octal  integer: 

N  =  LAS (0) 

PRINT  (13,1)  N 
1  FORMAT  (IX, 06) 

END 

Frequently  a  program  contains  a  number  of  optional  features  that 
the  user  must  selectively  request.  A  simple  way  to  tell  this  type  of 
program  what  options  are  needed  is  to  assign  one  data  switch  per  option. 
In  order  to  allow  FORTRAN  programs  to  test  single  data  switches,  a 
LOGICAL  FUNCTION  ISWTCH  was  written.  This  routine  is  referenced  as 
follows: 

ISWTCH (I)  where  I  =  INTFGER  variable  or  constant 

(0  <  I  <  17) 

ISWTCH (I )  returns  a  "TRUE"  value  if  and  only  if  data  switch  "i"  is  on. 

A  FORTRAN  statement  that  would  pause  whenever  both  data  switches  # 0 
and  #6  were  on  is  coded  as 

IF  (ISWTCH (0)  .AND.  ISWTCH (6))  PAUSE. 

A  flowchart  depicting  ISWTCH 's  operation  is  given  in  Figure  5. 

RIPOFF  Subroutine 

This  subroutine  was  written  to  convert  data  recorded  on  magnetic 
tape,  or  annlog-to-digital  converted  data  to  a  format  consistent  with 
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Fig.  5  Flowchart  for  ISWITCH  Program 

the  internal  formats  for  data  values.  Certain  magnetic  tape  input/ 
output  routines  pass  the  data  to  the  calling  program  without  removing 
the  parity  bits.  Also,  A/D  converter  data  is  12-bits  wide.  Thus  nega¬ 
tive  values  are  not  properly  represented  in  an  18-bit  word.  This  sub¬ 
routine  corrects  for  both  problems.  It  is  currently  in  use  as  a  FOR¬ 
TRAN  callable  library  routine. 

REA  Subroutine 

The  RSX  operating  system  utilizes  core  partitions  outside  of  the 
monitor  for  input-output  device  handlers.  The  use  of  these  partitions 
is  not  allowed  by  other  tasks  if  the  device  is  on  line  and  in  use  by 
the  system.  This  subroutine  was  developed  to  dynamically  reallocate 
the  core  space  used  by  these  handlers  by  reassigning  the  device  off  line. 
This  allows  th*  use  of  a  peripheral  device  (such  as  a  line  printer)  to 
be  deferred  during  real  time  operations  (such  as  digitizing),  then 
returned  for  use  during  a  following  off-line  operation,  under  program 
control.  It  is  a  FORTRAN  callable  routine,  currently  used  in  the  Digit  I 
program. 

GT132  Subroutine 

One  other  special  purpose  subvoutnine  is  included  in  the  disk- 
resident  user  library.  The  routine  was  created  because  of  an  early 
need  to  rend  dititized  EEG  magnetic  tapes.  Normally  these  tapes  would 
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have  been  read  by  the  standard  FORTRAN  input  statements.  However,  at 
the  time  these  tapes  were  needed  a  FORTRAN  program  could  not  read  them 
because  of  errors  in  the  hardware  and/or  software. 

Therefore,  a  subroutine,  GT132,  was  written  which  would  read  one 
record  (132  characters  long)  from  a  digitized  EEG  tape  and  pass  this 
record  to  the  user.  The  calling  sequence  for  GT132  is 
Call  GT132 (BUF, EOF) 

where  BUF  =  27  element  DOUBLE  INTEGER 
array 

EOF  =  FORTRAN  statement  number 

Eacl  call  to  GT132  places  a  tape  record  into  BUF  unless  an  end-of-file 
is  encountered.  In  the  latter  case  GT132  returns  control  to  the  state¬ 
ment  specified  in  EOF  instead  of  executing  a  normal  RETURN  statement. 

As  shown  in  the  flowchart  in  Figure  6,  GT132  translates  the  EBCDIC 
characters  on  tape  into  the  ASCII  character  equivalents  required  by  RSX 
after  first  reading  the  tape  in  binary.  DEC  just  recently  corrected 
the  problem  so  that  we  are  now  able  to  read  the  tapes  with  the  FORTRAN 

I 

READ  statement. 


Fig.  6  Flowchart  for  GT132  Program 
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(B)  Applications  Programs 


Digit  1 

This  program  was  developed  as  a  utility  program  to  digitize  analog 
data  (online  or  from  analog  tape)  and  record  it  on  digital  magnetic 
tape  for  offline  analysis.  The  present  version  is  an  intermediate 
program  in  two  ways.  First,  it  is  expected  to  be  revised  to  take 
advantage  of  modifications  in  the  analog  to  digital  conversion  hardware 
to  allow  faster  sampling  rates.  Second,  it  is  intended  for  general 
purpose  data  acquisition  until  command  and  control  functions  are  being 
issued  real  time.  At  that  point,  no  longer  will  all  data  be  recorded 
and  then  analyzed  later;  only  selected  data  will  be  output  as  the  real 
time  function  is  being  performed. 

The  program  uses  a  sequence  of  several  tasks  to  complete  the  data 
collection  and  recording.  Digit  1  is  requested  by  the  user;  it  per¬ 
forms  initialization  and  reallocates  a  partition  for  use  by  the  actual 
data  collection  routine.  Data  for  an  identification  file  is  input 
either  from  the  card  reader  or  from  the  teletype,  and  this  header  file 
is  written  on  the  output  tape.  When  complete,  the  data  acquisition 
task  (INTK5)  is  fixed  in  core  and  scheduled  to  run  at  5  millisecond 
intervals.  This  task  Inputs  data  via  the  A/D  converter,  and  outputs  to 
magnetic  tape,  using  buffered  output.  Following  completion  of  data 
collection  (as  indicated  by  the  user  setting  a  console  switch),  task 
digit  2  is  run.  This  task  cancels  and  removes  INTK5  from  core,  and 
allocated  the  partition  back  to  the  line  printer  handler.  A  brief  tape 
verification  is  then  run,  printing  the  header  record  and  scanning  for 
record  numbering  errors  as  an  indication  of  data  loss.  A  general  flow¬ 
chart  depicted  in  Figure  7  shows  program  operation. 
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CRTPCT,  SYSTIM 


These  programs  were  a  derivative  of  the  digitizing  routine  written 
to  output  data  values  to  the  system  CRT  During  data  acquisition.  A 
r ingle  circular  buffer  of  data  was  filled  during  A/D  sampling  for  CRT 
output,  and  the  buffer  was  repetitively  scanned.  Any  of  the  four  input 
channels  can  be  viewed,  with  alphnumeric  identification  of  the  channel. 
System  time  is  also  displayed.  The  program  is  used  primarily  as  a 
system  checkout  aid,  since  the  CPU  time  required  for  rescan  of  the  CRT 
degrades  timing  accuracy.  The  program  is  being  converted  to  run  with 
the  storage  CRT,  and  better  results  are  expected. 

(C)  Software  Investigation: 

Practically  all  of  our  data  are  in  analog  form.  It  is  imperative 
that  we  should  have,  in  operation,  a  good  analog-to-digital  converter 
used  to  input  data.  An  I/O  handler  package,  produced  by  the  manufac- 
turerer,  was  available,  and  several  versions  of  INTK  were  written  to 
take  advantage  of  this  handler.  A  measurement  method  was  designed  to 
utilize  a  square  wave  input  (at  lOHZ)  and  an  offline  data  analysis 
program  which  searched  through  the  data  to  determine  the  consistency 
and  accuracy  of  A/D  operation.  It  became  obvious  that  accuracy  of  the 
A/D  was  not  a  significant  cause  of  error,  but  that  millisecond  level 
scheduling  of  the  data  collection  task  was  causing  severe  CPU  utiliza¬ 
tion  problems.  The  strategy  chosen  was  to  tune  both  the  hardware  and 
the  software  for  optimum  A/D  operation. 

Accordingly,  the  standard  I/O  handler  was  replaced  with  a  high 
speed,  less  general  driver  which  reduced  the  need  to  schedule  two  tasks 
virtually  concurrently.  In  addition,  a  hardware  modification  (not 
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yet  Implemented)  war  designed  to  allow  the  A/D  to  operate  on  its  own 
clock  rather  thnn  requiring  n  CPU  driven  tnsk  to  schedule  each  A/D 
operation.  It  Is  expected  that  in  combination,  these  will  allow  n  sub- 
stnntlnl  incrense  in  the  digitizing  rnte  thnt  enn  be  suppe  ted  by  the 
system. 

The  present  version  of  the  c'l-ilizing  program,  digit  1,  utilizes 
the  high  speed  driver  described  above.  The  results  of  the  analysis 
were  thnt  the  mnxlmum  error  rnto  under  the  present  conf lgurntion  approaches 
one  sample  lost  due  to  high  CPU  londlng  eveiy  two  seconds. 

Problems  of  this  type  nre  not  analytically  solved.  The  solutions 
are  found  with  the  particular  operating  system  nnd  hnrdware  involved. 
Further  work  of  this  type  is  expected  as  more  tasks  operate  in  a  real¬ 
time  environment.  A  significant  effort  in  the  systems  operation  is  to 
eliminate  scheduling  problems,  such  ns  this  one. 

III.  REAL-TIME  MONITORING  TECHNIQUE  AND 
MODELLING  OF  EEG  SIGNALS 

i 

We  describe  here  a  new  technique  for  real-time  monitoring  and  pre¬ 
dicting  brain  states  via  EEG  signals.  The  EEG  waveform  is  assumed  to 
be  a  narrow-band  process  whos  spectrum  is  centered  around  a  mean  fre¬ 
quency  which  may  be  slowly  varying.  Designating  the  EEG  signal  by  f(t), 
we  have  f(t)  =  e(t)  cos  [uftjj  =  e(t)  cos  u>Qt  +  ¥>(t)  = 

s(t)  sin  w  t  +  c(t)  cos  w  t  ; 
o  o 

By  tracking  the  central  frequency  ,  we  may  represent  the  signal  by 

the  two  ptxocssos  s  (i )  and  c(t)  .  If  the  process  is  stationary  whose 
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spectrum  is  symmetric  about  ,  then  s(t)  and  c(t)  arc  uncor- 

i  . 

related  so  the  prediction  would  be  easier  to  deal  with. 

To  obtain  the  in-phase  component  c (t)  and  the  quadrature  com- 

ponent  s(f.)  ,  we  use  a  discrete  "phase-iocked  loop"  system  as  described 

, 

in  the  block  diagram  shown  in  Figure  8.  This  system  tracks  the  center 

i 

frequency  w  and  resolves  the  EEC  waveform  into  c(t)  and  s(t) 

Once  c(t)  and  s(t)  are  obtained  for  a  window  width  of  the  EEG  signal, 

I  * 

•  i 

we  reduce  the  data  by  taking  the  mean  value,  the  mean  slope,  etc.  This 
is  done  by  fitting  n  linear  segment  to  the  data  in  the  window  through  , 

recursive  filtering.  The  values  thus  obtained  serve  as  data  vector 

.  '  1  ' 

components.  , 

•  !  : 

The  key  to  the  sucess  of  this  real-time  monitoring  technique  is  the 
discrete  phase-locked  loop  system  depicted  in  Figure  8.  This  system  in¬ 
cludes:  '  ! 

(a)  Voltage-controlled  oscillator 

(b)  Frequency  discriminator 

(c)  Low-pass  filters 


Fig.  8  A  Discrete  Phase-Locked  Loop  System 
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They  arc  realized  as  follows: 

I 

(a)  The  VCO  is  realized  by  generating  the  sine  and  cosine  wave- 

i  : 

forms  through  the  difference  equations 
,  S  (N )  =  OS(N-I)  +  C(N-l) 

and  C  (N )  =0'C(N-1)  -  ps(N-l)  . 

Since  the  frequency  and  the  amplitude  are  functions  of  a  and  p  , 
we  control  these  parameters  in  such  a  way  ss  to  maintain  a  constant 

'  ‘  i 

amplitude  and  to  change  the  frequency  in  accordance  with  the  output 

I  ‘ 

of  the  discriminator.  Specifically,  we  maintain  unit  amplitude  by 
2  2 

making  a  +  P  —  1  and  increase  or  decrease  the  frequency  by  increasing 
or  decreasing  the  parameter  p  according  to  the  output  of  the 
discriminator. 

i  i 

(b)  We  have  not  yet  found  a  satisfactory  frequency  discriminator 
which  operates  on  sampled  data.  The  one  which  we  have  tried  so  far  is 

i  1  i 

of  the  slope  type,  i.e.,  the  frequency  is  related  to  an  averaged  slope 

J  • 

of  the  waveform.  It  seems  that  we  have  to  learn  more  statistical 
!  properties  of  the  rate  of  change  of  the  center  frequency  of  the  EEG 
°  -  waveform  before  we  could  decide  on  a  particular  type  of  frequency 
discriminator.  This  rate  of  change  of  frequency  could  be  measured 

I 

directly  from  EEG  signals  [l] . 

i  1 

(c)  The  lowpass  filters  are  a  standard  3-polc  Butterworth  filter 
with  a  3-db  bandwidth  about  5  Hz.  This  digital  filter  is  discussed  in  [2]  . 
The  two  output,  signals  c(t)  and  s(t)  of  the  previous  system  are 

then  fed  separately  into  linear  digital  filters  that  fit  to  each  of 
them  the  best,  linear  approximation  in  a  window  of  k  samples  in  the 

|  i 
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least  mean  square  sense.  The  width  of  the  window  was  chosen  to  be  0.15 
sec.  The  two  parameters  of  the  linear  approximation,  viz. ,  the  mean 
and  the  slope,  are  calculated  recursively  by  digital  filters  known  as 
the  "comb"  and  "slope"  filters.  These  filters  arc  the  digital  reali¬ 
zation  of  the  transfer  functions  given  by 

sinKx 


c(j  )  = 


sinx 


s(j  )  —  sin  [(K+l)x1  _  (K+l )cosKx 

4sinx 


4sin^x 


where  c(j  )  and  s(j  )  are  the  amplitude  response  of  the 
comb  and  slope  filters,  respectively;  and  x  is  the  normalized  fre¬ 
quency.  The  value  for  K  is  (J3  which  corresponds  approximately  to 
the  window  width  of  0.15  sec.  The  normalized  frequency  X  is  calcu¬ 
lated  by 

ojT 
X  =  - - 

where  T  is  the  sampling  period  (2.5  msec),  w  is  measured  by  radians/ 
sec. 

The  phase  characteristics  of  the  two  filters  arc  of  the  oame  linear 

type 

phase  (W)  =  i^-i^SYT 


These  filters  are  block  diagrammed  in  Figure  9. 


Fig.  9  Block  Diagram  for  Linear  Fitting  Filters 
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It  should  be  noted  that  the  four  outputs  of  these  filters  contain  infor¬ 
mation  about  the  frequency  and  may  be  used  as  frequency  discriminator. 

If  higher  order  "derivatives"  are  needed,  they  can  be  obtained  by  using 
recursive  filters  in  a  similar  fashion. 

We  have  not  yet  implemented  a  prediction  scheme;  however,  a 
scheme  to  be  described  has  been  developed.  Let  X  be  a  vector  whose 
components  consist  of  K  past  samples  of  EEG  process,  i.e., 


X 


K 


Vi 


N-K+l 

where  N  represents  the  present  instant  of  time.  Our  aim  is  to  pre¬ 
dict  the  value  of  the  process  sample  at  the  future  instant  L  ,  viz., 


n+L 


Because  of  the  real-time  prediction  requirement,  we  have  to 


K 


transform  X  into  another  vector 


yM 


with 


Y*. 


QX 


K 


where  Q  is  an  MXK  matrix  with  M«K 
yM  . K 


Our  prediction  algorithm 

will  operate  on  Y  rather  than  X”  to  produce  the  predicted  value  of 

XN+L  .  For  instance,  the  predicted  value  X  would  be  obtained  by 
A  M 

Vl  =  (rV1)  =  •  E  BiYi  - 

i=l 


if  a  linear  predictor  is  used.  We  are  in  the  process  of  finding  the 
optimal  B^'  and  Q  for  a  given  L,M,  and  K.  These  optimal  BM  and 
Q  are  time-varying  for  non-stat ionary  processes  such  as  the  EEG 
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process.  In  this  situation,  they  will  have  to  be  tracked  by  using 
measurements  of  the  prediction  error  or  by  some  other  means. 

In  closing  the  control  loop,  we  need  an  adaptive  model  whose  out¬ 
put  is  used  as  an  input  to  the  controller.  This  adaptive  model  serves 
as  a  check  for  our  outputs  from  the  predictor.  An  autoregressive  pro¬ 
cess  has  been  used  for  the  modelling  of  EEG.  In  the  following,  we 
describe  this  method  and  some  results  obtained  so  far. 


An  autoregressive  (AR)  process  of  order  p  can  be  described  by 


the  equation 


c  =  4> , *  ,  +  „+• ..  +  +  e^ 

t  1  t-1  2  t-2  P  t-p  t 


where  x^  '  xt,  i . .  tlie  values  of  the  Pr°cess  at  equally  spaced 

times  t,t-l,...,  and  the  e^  are  zero  mean,  independent,  identically 
distributed  random  variables,  i.e.  white  noise.  Here  it  is  assumed  that 
the  mean  p  of  the  process  is  zero.  Otherwise  x^.  should  be  replaced 
by  x(t)  =  x(t)  -  p  in  the  above  equation. 

An  AR  process  can  be  stationary  or  non-stationary .  It  can  be 
shown  that  for  the  process  to  be  stationary,  the  roots  of  the  charac¬ 


teristic  equation 


4*(B)  =  l-4>.B-% B2-. .  .-4)  BP  =  0 

1  A  ct  P 

must  lie  outside  the  unit  circle  [3]  .  For  a  stationary  AR  process  the 
autocorrelation  function  consists  of  a  mixture  of  damped  exponentials 
and  damped  sinusoids,  depending  on  the  roots  of  the  above  equation.  It 
should  be  noted  that  the  autocorrelation  function  of  an  EEG  exhibits  a 
damped  sinusoidal  behaviour  M  • 

The  above  model  contains  p+1  parameters  ,  4>9  1  •  •  **6p  and  the 
variance  of  the  noise.  Since  an  EEG  is  a  varying  amplitude,  frequency 
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and  phase  process,  it  is  estimated  that  at  least  a  fourth  order  process 
will  be  needed  to  model  it  [5]  < 

We  estimate  the  parameters  by  using  the  following  method: 

Consider  the  equation 

Xt  =  Vt-l  +  *2Xt-2  +“  ‘  +  ^pVp  +  et 

multiply  by  an<^  take  expectations  to  get 


ci  “  4*, c  +  <t>  c  +..H-  A  C  „ 
k  1  k-1  T2  k--2  YP  k-p 


k  >  0 


where  is  the  autocovariance  at  lag  k  and  E(x  *e  )  =  0,  since 

t"k  t 

the  noise  being  white,  is  uncorrelated  with  the  past  values. 

Dividing  by  the  variance  c 

o 

rk  ■  Vk-1  +  Vk-2  +-fVk-p  k  >  0 

where  r  is  the  autocorrelation  at  lag  k. 

K 


Substituting  k  =  1,2,... p  in  the  above  difference  equation, 

rl  =  ♦l  +  Vl  +"'l*prp-l 
r2  ■  *  +2  +Vp-2 


r  =  A,  r  +  <jvr  ,  +  ...+  A 

p  Y1  p-1  Y2  p-1 

which  are  the  Yule-Walker  equations  [6]  , [7],  If  the  actual  autocor¬ 
relations  were  known,  the  parameters  <f> x  , . .  yj,  can  be  obtained  by 
solving  these  linear  equations.  The  Yule-Walker  estimates  are  obtained 
by  using  the  estimated  autocorrelations  r  in  the  abov «  equations. 

K 
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2  2 

For  k  =  0  ,  E(x  .  e  )  -  E(e  )  =  c  so  that 

t  t  t  e 


c  =  <j>  c  +  4>  c  +...+  <b  c  +  o' 
o  11  22  Tp  p  e 


and  cr  can  be  estimated  by  substituting  the  estimated  c's  and  <j>'s 

The  Yule-Walker  estimates  rre  fairly  accurate.  However,  the  least 
squares  and  the  maximum  likelihood  estimates  are  statistically  more 
significant.  If  we  assume  that  the  process  is  Gaussian  (i.e.,  the  e^ 
are  normally  distributed),  then  it  can  be  shown  [3]  that  the  least 
squares  estimates  are  given  by 

*  A  4 


D12  “  AD22  +  ^2D23  +  ***  +  V 


P  2 , p+1 


D13  =  V23  +  V33  +-+  Vs, P+1 


Dl,p+1  V2,p+1  +  ^2D3,p+l  +*~+  ^pDp+l,P+l 
where  D..  =  D..  =  x.x.  +  +...+  Vl-jVl-i  ("  iS  ^  t0tal 

number  of  terms  in  the  series).  The  least-squares  estimates  can  then  be 
obtained  by  solving  the  above  equations. 


The  exact  maximum  likelihood  estimates  can  only  be  obtained  by 
solving  certain  nonlinear  equations.  However,  approximate  estimates 
are  obtained  by  solving  certain  nonlinear  equations.  However,  approxi¬ 
mate  estimates  are  obtained  by  sl'oving  linear  equations  similar  to  the 

.  nD 
♦  11 

above  set  but  with  D.  .  replaced  by  D.  .  =  - — * — : — v  .  For  large  n 

ij  ij  (n-i-j+2)  b  ’ 

if  the  estimates  are  not  close  to  the  boundary  between  the  stationary  and 
non-sta^ xonary  zones,  the  differences  between  three  estimates  is  small. 
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The  model  is  then  used  to  predict  the  EEG  process.  These 


predicted  values  are  used  to  check  the  predicted  values  from  raw  EEG. 
The  prediction  scheme  by  the  use  of  the  model  is  described  next.  The 
minimum  mean-square  error  prediction  filter  is  simply  described  by  the 

difference  equation 

a  ,  a  ,  a  ,  A 

X  =  <J>  X  +  <+>  X  +••  (b  X 
t  1  t-1  2  t-2  P  t--p 


so  that  the  prediction  algorithm  is  quite  simple.  It  can  be  seen  that 
the  characteristic  equation  of  this  filter  is 

i  -  ^z-1  -  4>2z-2  -  ...  -  4>pz~p  =  0 


so  that  the  filter  is  stable  if  the  roots  of  the  above  equation  lie 
inside  the  unit  circle.  Thus  the  filter  is  stable  if  and  only  if  the 
parameters  correspond  to  a  stationary  process.  Once  the  parameter?  have 
been  estimated,  the  model  has  to  be  checked  (jy  using  goodness-of-f it  tests. 
An  estimate  of  e^  is 


A 


A 

6  x 
lt-1 


It  can  be  shown  that  [3] 


A 

e 


t 


Vt-2 


x 

t-p 


so  that  as  n  increases,  approximates  white  noise  more  and  more. 

The  estimated  autocorrelations  of  e^  can  be  shown  [s]  to  be  distributed 

approximately  normally  with  mean  zero  and  variance  —  .  Then  e 

n  t 

can  be  calculated  and  its  autocorrelations  estimated,  which  can  be  used 

to  check  the  model. 

Another  test  is  to  use 
k  2 

Q  =  n  £rk2(e) 
k=l 
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If  the 


where  the  r  '  e  arc  the  estimated  autocorrelations  of  e 
k  ^ 

model  is  adequate,  Q  is  approximately  distributed  as  X  (K-p)  [9].. 

This  can  be  used  to  get  a  quantitative  result  about  the  goodness  of  fit. 

Now,  we  will  give  some  of  the  results  obtained.  We  used  the  EEG 
data  provided  by  NASA-Amcs  Research  Center.  Two  types  of  data  were 
used,  one  a  spontaneous  EEG  and  the  other  an  EEG  obtained  when  stro¬ 
boscopic  light  was  flashed  into  the  closed  eyes  of  the  subject  at  the 
approximate  alpha  frequency.  The  data  was  sampled  at  833.3  samples 
per  second. 

The  processing  of  the  data  was  carried  out  on  a  PDP-15.  The  data 
was  first  filtered  using  a  narrow  band-pass  digital  filter  so  as  to 
isolate  the  alpha-frequency  component.  The  filtered  data  was  then 
divided  into  small  blocks  covering  a  time  interval  of  about  1.2  seconds 
each,  over  which  the  EEG  process  may  be  regarded  as  stationary.  A  computer 
program  which  gives  all  three  types  of  estimates,  computes  e^  and  its 
autocorrelations  and  also  computes  Q  ,  was  used.  Some  approximate 
methods  can  be  used  to  estimate  the  order  p  of  the  process  but  it 
was  found  simpler  and  better  to  specify  it  as  a  variable  which  could  be 
input  to  the  program.  In  the  actual  program,  p  could  be  varied  be¬ 
tween  2  and  10. 

The  results  obtained  indicate  that,  an  AR  process  model  docs  not 

fit  the  EEG.  The  estimated  autocorrelation  of  e^  were  quite  high 
2 

and  the  X  test  also  indicated  a  lack  of  fit. 

The  predictive  filter  was  used  and  the  actual  and  predicted  time  ser¬ 
ies  was  plotted  on  a  calcomp  plotter.  It  was  found  that  for  some  least 
squares  and  maximum  likelihood  estimates,  the  predictive  filter  is 
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unstable  which  indicates  that  the  maximisation  occurs  in  the  nonsta¬ 
tionary  region. 

The  results  obtained  so  far  do  not  live  up  to  our  expectation. 

The  model  may  have  to  be  refined.  Other  models  are  being  investigated. 

IV.  PRELIMINARY  WORK  CN  EYE-MOVEMENT  TRACKING 

All  of  the  equipment  necessary  for  the  initial  eye-movement  ex¬ 
periments  has  arrived  and  software  for  processing  the  eye-movement  data 
is  under  development.  We  have  become  familiar  with  adjusting  the  sensors 
on  the  eye-movement  apparatus  to  obtain  large  and  symmetrical  deflec¬ 
tions  in  both  horizontal  and  vertical  directions.  These  adjustments 
are  somewhat  involved  and  difficult,  but  they  are  very  necessary  for 
obtaining  accurate  results.  With  practice  we  have  been  able  to  get 
better  and  better  adjustments,  and  we  are  now  satisfied  with  our  results 
and  confident  of  our  ability  to  rapidly  and  accurately  adjust  the  sensors 
for  optimum  performance. 

We  have  nearly  completed  the  calibration  procedures  and  algorithms 
for  the  eye-movement  measuring  instrument.  These  calibrations  ar? 
necessary  for  obtaining  accurate  measurements  because  they  provide  a 
calibration  matrix  as  a  reference  for  all  subsequent  experimental 
measurements.  Consequently,  we  are  taking  great  care  to  insure  a  valid 
calibration  procedure  that  is  also  convenient  to  use,  because  it  will 
probably  be  necessary  to  check  our  calibrations  frequently  throughout 
the  course  of  our  experiments. 

Basically,  the  calibration  procedure  involves  the  following: 
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(a)  digitizing  the  subject's  eye  movements  on-line  with  the  A/D  con¬ 
verter  and  displaying  these  as  points  on  the  computer  oscilloscope, 
much  the  same  as  displaying  the  movements  directly  on  an  oscilloscope. 
This  computer  "feed  through"  is  used  so  that  the  experimenter  can  tell 
the  computer  to  store  certain  calibration  points  for  later  reference 
during  the  actual  experiment;  (b)  the  experimenter  instructs  the  sub¬ 
ject  to  fixate  on  particular  points  of  a  calibration  matrix  (both 
square  and  circular  matrices  are  used)  and  adjusts  the  eye  movement 
sensors  so  as  to  get  the  scope  tracing  to  approximate  as  closely  as 
possible  the  particular  matrix  being  observed;  (c)  when  a  good  approx¬ 
imation  has  been  obtained  on  the  scope,  the  experimenter  instructs  the 
subject  to  look  at  a  particular  point  in  the  matrix  and  then  tells  the 
computer  via  the  switch  register  or  the  teletype  to  store  that  point's 
coordinates  in  a  matrix  array.  This  is  an  averaging  process  which 
samples  the  EMM  output  over  a  period  of  time  while  the  subject  is  fix¬ 
ating  on  the  given  point  so  that  the  effect  of  eye  blinks  and  other 
artifacts  can  be  reduced  or  ignored;  (d)  when  all  the  calibration 
points  have  been  inputted,  the  experimenter  can  display  the  points  to 
check  that  the  matrix  was  inputted  properly;  if  not,  (c)  and  perhaps 
even  (b)  should  be  repeated  until  a  good  calibration  is  obtained. 

After  completing  the  calibration  routines,  we  will  start  on 
algorithms  for  processing  data  continuously  and  for  doing  things  such 
as  plotting  the  eye  movements  on  the  plotter  (not  real-time  plots  of 
course).  These  routines  will  depend  heavily  on  the  calibrations  des¬ 
cribed  above,  as  the  calibration  points  will  be  used  as  references  for 
interpolating  the  positions  of  the  movement  data. 
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V.  CONCLUSION 


The  work  has  been  proceeding  along  the  lines  as  planned  though  . 
not  at  the  pace  ns  expected.  We  encounterd  some  difficulties  in  the 
beginning  of  this  project.  These  have  largely  been  overcome.  The 
PDP-15  computer  system  is  running  satisfactorily.  There  still  remain 
several  laboratory  instruments  to  be  interfaced  with  the  computer  system 
and  some  utility  subroutines  to  be  written.  In  the  next  period,  we  will 
concentrate  on  generating  application  software  packages  and  realizing 
algorithms  for  such  schemes  ns  the  real-time  monitoring  and  prediction. 

We  have  investigated  some  renl-time  monitoring  and  prediction 
schemes  and  some  modelling  techniques.  One  of  such  a  scheme  has  been 
partially  implemented  and  tested.  A  modelling  technique  hzs  been 
implemented  and  tried  out.  The  preliminary  results  obtnined  from  the 
model  indicate  that  the  model  has  to  be  refined.  Also,  preliminary 
work  on  the  eye-movement  monitoring  and  tracking  has  been  completed. 
Further  work  on  the  measurement  of  eye-movements  and  eye-positions  are 
in  progress.  , 

Our  immediate  work  is  to  acquire  experimental  data.  With  appro¬ 
priate  experiments  and  the  analysis  of  the  eye-movement  and  cortical- 
state  data,  we  can  determine  the  right  timing  nnd  sequencing  of  satur¬ 
ation  and  test  stimuli  for  obtaining  persistent  nnd  exclusively  pos¬ 
itive  after-images  or  persistent  and  exclusively  negative  after-images. 
By  using  the  continuously  updated  information  concerning  the  eye-posi¬ 
tion  and  cortical  state  for  adjusting  the  stimulus  parameters,  we  will 
be  able  to  enhance  the  vividness  and  persistence  of  these  after-images. 
We  then  will  close  the  control  loop  for  enhancing  memory  functions  by 
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incorporating  all  these  information  and  techniques  implemented  through 
the  system  as  block  diagramed  in  Figure  1.  The  work  remaining  to  be 
accomplished  is  the  integration  of  the  various  techniques,  implementa¬ 
tion  of  various  schemes,  and  the  determination  of  the  appropriate  stim 
ulus  parameters  via  the  analysis  of  tho  experimental  data. 
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